System for transporting sampled signals over imperfect electromagnetic pathways

ABSTRACT

Infrastructure electronics equipment incorporates infrastructure Local-Site Transports (LSTs). LSTs convey payload sampled signals over imperfect electromagnetic (EM) pathways whose physical properties are usually unknown when the equipment (e.g., Cameras, Displays, Set-Top Boxes) is manufactured. Prior LSTs hedge against EM pathway degradation in several ways: requiring high-quality cables (e.g., HDMI); restricting transmission distance, (e.g., HDMI); and/or reducing quality, via compression, to extend transmission distance somewhat (e.g., Ethernet). The subject of this disclosure is an infrastructure LST for sampled signals that causes the physical errors inevitably arising from propagation of sensory payloads over imperfect EM pathways to manifest in a perceptually benign manner, leveraging legacy infrastructure and reducing costs to achieve a favorable ratio of fidelity to transmission distance.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. application Ser. No.16/199,559, filed Nov. 26, 2018, which is a Continuation of U.S.application Ser. No. 15/925,123, filed on Mar. 19, 2018 (now U.S. Pat.No. 10,158,396, issued Dec. 18, 2018), which is a Continuation ofInternational Application No. PCT/AU2016/050880, filed on Sep. 21, 2016,which claims priority to Australian Patent Application No. 2015903845,filed on Sep. 21, 2015, all of which are incorporated herein byreference in their entirety.

FIELD: INFRASTRUCTURE LOCAL-SITE TRANSPORT (LST)

The field of the disclosure is infrastructure local-site transport (LST)for conveying sampled signals between equipment pairs connected by EMpathways provided within constructed environments, such as within a roomor within a vehicle or throughout a building or across a campus.

BACKGROUND

Video Systems

A video system includes Displays, Sensors, Signal Processors,Image/Video Stores, and Control Interfaces, as well as in some cases anInternet connection. The subject of this disclosure is local-sitetransport (LST), which locally interconnects video system equipment.Video equipment serves local environments. LST operating withinenvironments occupied by people is distinguished fromtelecommunications, which interconnects remotely located equipment.Internet servers provide the content and manage the interactiveexperiences which are presented to consumers via video systems in anylocation connected to the Internet. That is why video systems are anintrinsic aspect of every delivery system for pixel-rich information.

Infrastructure Video Systems Versus Mobile Video Systems

There are two kinds of video systems: Mobile and Infrastructure. Thesetwo types of system differ from one another in two ways: 1) Mobilesystems are monolithic, whereas Infrastructure systems are assembled bycustomers or their agents from disparately manufactured equipment, and2) Mobile systems draw power from batteries, whereas Infrastructuresystems draw power from mains electricity. To summarize:

-   -   Mobile video systems draw power from batteries and are typically        monolithic, each assembled by a single manufacturer from various        components. For example, a smart phone implements a video        processor, which reads multiple cameras and drives a palm-size        screen, all packed within one enclosure.    -   Infrastructure video systems are powered by mains electricity        and are assembled by customers from equipment that is produced        by various manufacturers.

Both kinds of video systems are important for creating and accessingInternet content. Nevertheless, these two kinds of video systems presentstarkly different engineering challenges.

Mobile video systems are more readily integrated into a person'severyday life than Infrastructure video systems, due to portability.

Infrastructure video systems generate experiences that are moreimmersive than their Mobile counterparts because of the ability ofimmersive Virtual Reality (iVR™) to surround us with Displays andSensors while drawing potentially large amounts of electrical power forarbitrarily long durations.

Example applications of Mobile video systems include

-   -   Collecting/posting Social Media material    -   Augmented Reality (AR) games, such as Pokémon GO    -   Virtual Reality (VR) systems wherein displays and/or cameras are        tethered to a portable Media Processing Unit (MPU), which might        itself be a smart phone or another portable device

Example applications of Infrastructure video systems include

-   -   Video surveillance    -   Machine vision    -   Motor vehicle safety (sometimes related to machine vision)    -   Retail signage    -   Shopper behavior analysis (sometimes related to machine vision)    -   Motor vehicle driver and passenger navigation, control, and        entertainment    -   Home Entertainment    -   immersive Virtual Reality (“iVR”), wherein cameras monitor the        subject and displays surround the subject, such that the video        system captures and presents pixel information from all angles

Examples of Infrastructure video equipment include desktop (or tower)PCs, PC monitors, set-top boxes, TVs, video surveillance cameras, videosurveillance recorders, video surveillance monitors, vehicle navigationand safety cameras, vehicle electrical control units (ECUs), automotivecontrol & navigation displays, automotive entertainment cameras,automotive entertainment displays, retail and kiosk displays, iVRcameras, and iVR displays. The Infrastructure video equipment marketsector is large and growing fast.

By contrast, there is no Mobile video equipment market. All of thecomponents within a Mobile video system (the Internet Interface, digitalProcessor, Camera(s), and Display(s)) operate in close proximity, suchthat the entire system can be worn or carried. The interconnectionsoperate over short ranges under well-controlled conditions, and all ofthe components are supplied as a monolithic entity, such that thecustomer has no choices to make.

Infrastructure video systems, by contrast, place great demands on videointerconnections. Infrastructure video equipment is mounted at arbitrarylocations within a building or campus, and the video is carried over adiversity of physical pathways including metal cables, radio, and/oroptical fibre between independently manufactured equipment.

Video Local-Site Transports (LSTs)

This disclosure addresses one aspect of Infrastructure video systemimplementation: Local-Site Transport (LST). An LST conveys a videosignal over an electromagnetic (EM) propagation pathway from a sendingpiece of equipment to a receiving piece of equipment located as far ashundreds of metres away from the sending equipment.

Three examples of electromagnetic (EM) pathways include electricity overwires, radiation through the air, and photons through a fibre. LSTsrepresent the transported video as EM energy in a form appropriate tothe medium, for example voltage, radio waves, or light.

Types of Signal

For the purposes of this disclosure, a signal is a variable, conveyed asEM energy whose amplitude changes over time.

Two attributes characterize every signal:

-   -   Time        -   Continuous: The time between values is limited by the            resolution at which it is possible to measure time        -   Discrete (“Sampled”): The time between values is            predetermined, and its inverse is the sampled signal's            “sampling rate”    -   Amplitude        -   Continuous: The number of possible values is limited by the            resolution at which it is possible to measure energy        -   Discrete (“Quantized”): The number of possible values is            predetermined, and its logarithm base 2 is the quantized            signal's “number of bits”

There are four combinations of these attributes and thus four distincttypes of signal:

-   -   “Analog” signals are continuous-time, continuous-amplitude        signals.    -   “Digital” signals are discrete-time, discrete-amplitude signals.    -   “Pulsatile” signals are discrete-time, continuous-amplitude        signals. There is an appropriation of this unusual meaning of        the term “pulsatile” for clarity in this disclosure. Pulsatile        signals are commonly processed with “sampled analog” circuits,        while others also skilled in the art might prefer the term        “sample-and-hold” circuits.    -   “Neuronal” signals are continuous-time, discrete-amplitude        signals. This is not necessarily the usual meaning of the word        “neuronal,” but is fitting for this fourth quadrant of the        taxonomy. Neuronal signals are outside the scope of the present        disclosure.

This disclosure introduces local-site transport (LST) methods andapparatuses for sampled payload signals. Each payload signal is anordered series of samples. The payload signals are processed insuccessive “snippets,” where a snippet is a contiguous sub-series fromthe ordered series of samples comprising the signal. The methods andapparatuses disclosed herein are suitable for pulsatile signals and fordigital signals. Band-limited analog signals may be sampled, such thatthey are also amenable to transport by the LSTs disclosed herein.

Video Signals

Video signals are used as examples of sampled payload signals forspecificity where appropriate herein. There are many alternative,equally useful electronic formats for video signals. In any case, whileimages are two-dimensional objects, no matter what the color space ofthe electronic format and the resolution of each frame and the framerate, every video signal is ultimately represented as a one-dimensionallist of color values, i.e., an ordered series of input values. Theseinput values are quantized for digital video and they are continuousvalues for pulsatile video.

Infrastructure Video LSTs

Mobile video systems are monolithic and compact, so LSTs are not acentral focus of Mobile video equipment design. By contrast, LSTs are acritical design consideration for Infrastructure video systems, becauseInfrastructure video systems are assembled by end customers fromequipment possibly made at various factories, and interconnected bydifficult-to-predict and sometimes difficult-to-constrain infrastructureEM pathways.

An Infrastructure video LST conveys a video signal over an imperfectmedium from the output terminal of a video sender, such as a camera orPlayStation, over an imperfect EM pathway to the input terminal of avideo receiver, such as a display or Xbox. The sender and receiver maybe implemented within a common enclosure, such as an all-in-one DVR withbuilt-in display, or the two may be nearby, such as an HDMI display anda set-top box, or the two pieces of equipment may be located atdifferent corners of a room, between fender and dash in a car, atopposite ends of a building, between buildings on a campus, or indifferent carriages along a train. LSTs for common media conveyingelectrical, RF, or optical signals represent the transported video ascurrent/voltage, radio, or light, respectively.

An LST that can re-use legacy infrastructure cabling would be especiallydesirable, because cable installation is expensive, so reusing legacyinfrastructure reduces installation costs. Such an LST is the subject ofthe present disclosure.

The following infrastructure LSTs are examples requiring a special kindof cable and connector:

-   -   EIA/CEA-861 (HDMI) is the LST for home entertainment. A set-top        box sends video over HDMI cable to a Display.    -   USB Video Class is the LST for webcams. A webcam streams video        over USB cable to a personal computer.    -   Ethernet is the LST for IP cameras. An IP camera streams video        over Unshielded Twisted Pair (UTP) cable to a LAN switch.

The following infrastructure LSTs are examples that do not require aspecial kind of cable and connector:

-   -   NTSC/PAL is the LST for legacy CCTV systems. CCTV cameras stream        video over RG-59 coaxial cable to DVRs.    -   A wide range of HD CCTV LSTs is now available, including HD-SDI        and several proprietary analogue HD solutions.

A variety of LSTs is used for Virtual Reality (VR) systems that capturea person's appearances and gestures while contemporaneously presentingpanoramic video.

Infrastructure video systems present a broad diversity of cablingchallenges. In some infrastructure video applications such as CCTV, theEM pathway characteristics are not known when the individual equipmentis manufactured. Some LSTs are therefore designed to tolerate a broaddiversity of coaxial, UTP, and other cables.

DVI, LVDS, and HDBaseT are among the many HD video LSTs.

LSTs may be characterized by the specific set of limitations andtrade-offs imposed. Unfortunately, the impacts of these limitations andtrade-offs tend to increase as the number of infrastructure videoequipment units and the resolution per video signal continue to increasein response to insatiable market demand.

SSDS-CDMA

In the search for an alternative LST, Spread Spectrum DirectSequence—Code Division Multiple Access (SSDS-CDMA) transmission systemsas defined in “Spread Spectrum Systems with Commercial Applications” byRobert C. Dixon, volume 3, Wiley & Sons 1994, is incorporated byreference into this specification.

SSDS is a signal transmission method in which each bit of the inputsignal is modulated by a higher-frequency Code in the transmitter, whilethe receiver correlates each sample of the received signal by asynchronized instance of the same Code.

SSDS is well known to confer multiple benefits, including resilienceagainst EM propagation pathway defects, including for example roll-off,dispersion, reflections, and aggressor signals.

SSDS accounts for reflected waves from impedance discontinuities: thecharacteristic delay of these reflected waves is very much longer than achip length. The only danger from reflections is locking on thereflected signal and not the main higher-intensity signal.

SSDS-CDMA is a transmission method combining several independent SSDStransmissions, through varying the Codes. The SSDS-CDMA receiverdistinguishes among the various transmitters based on the Code used byeach transmitter.

This disclosure addresses encoder assemblies and decoder assembliesadapted for use with arbitrarily impaired EM pathways.

An LST ideally delivers fit-for-purpose video. For human viewingapplications of video systems, a fit-for-purpose LST delivers asfaithful as possible a rendition of the payload video signal, whileintroducing a minimum of visually disturbing artifacts. The use oflegacy cabling is always the least-cost cabling method, all else beingequal, and fit-for-purpose LST can re-use legacy cabling, rather thanrequiring new or special cabling, and can utilize the full bandwidth anddynamic range of the cabling or other EM pathways in order to convey theessence of the video signals usefully over inexpensive cables.

In addition to the electrical ravages of roll-off, dispersion,reflections, and aggressor signals, factors such as incorrecttermination, crimping under force, gnawing by rodents, and immersion inwater mean that there are likely to be propagation errors overinfrastructure cabling. Prior LSTs cause imperfections from EM pathwaypropagation to manifest as perceptually disturbing artifacts that canmaterially degrade the perceived value of sensory payloads. In order tomitigate the impacts on signal fidelity, these LSTs impose cable-lengthrestrictions along with costly compression and filtering circuits, allof which constrain system implementations, while simultaneously limitingfidelity.

SUMMARY OF THE PRESENT DISCLOSURE

This specification discloses in one aspect an LST for sampled signalsthat causes EM propagation errors to manifest perceptually benignly inreconstructed payload signals, thereby providing best-one-might-dotransport of sensory signals over imperfect EM pathways for humanperceptual purposes.

Not all aspects of a sensory signal—for example, visual, auditory,pressure, haptic, chemical, etc.—are equally useful/valuable in thehuman brain's perception of the content of the signal, with respect toany given purpose. For example, a certain level of noise (a low pSNR)may render a video signal absolutely un-viewable and ineffective. On theother hand, people are readily able to discern important representativeforms—ponies, puppies, other people, etc.—through considerable amountsof “snow,” even despite extremely low pSNR.

In particular, each of the human perceptual subsystems is very muchattuned to abrupt changes in sensory signals. For example, visualsystems have evolved to be sensitive to high-temporal-frequency andhigh-spatial-frequency light patterns—some speculate so as to make formore effective hunters. Some high-frequency sensory inputs make usuncomfortable. At the other end of the spectrum, humans also tend to betroubled by an absolute nullity of sensory stimulation. It may be thatpeople's senses prefer low-spatial-frequency and low-temporal-frequencyinputs both to the high-frequency alternatives, and also to no signal atall. For example, some people rely on artificial audio white noise inorder to go to sleep. In an aspect, the present disclosure contemplatesenabling iVR™ (immersive Virtual Reality) systems that presentelectrical errors as visual white noise in ways that people find helpfulor soothing.

Prior digital LSTs introduce a variety of high-temporal-frequency andhigh-spatial-frequency artifacts, which are disturbing to the eye. As aresult, in addition to the computational effort expended in reducing thebit rate required to represent the payload, by algorithmically removinginformation (compression), these digital LSTs impose a further additionof costly corrections to the artifacts introduced by the digital LSTs inthe first place. Examples of objectionable high-spatial-frequencyartifacts include “contouring” edges appearing in gradual gradientspresented over large digital display areas, and “blocking” artifactsarising from very minor errors on the order of 0.1% in the DC terms ofDCT blocks in motion-based compression algorithms.

In an aspect of the disclosure, the methods and apparatuses disclosedherein cause EM pathway impairments to manifest as white noise in thereconstructed payload signals. The brain's ability to, for example, “seethrough” visual white noise or “hear through” auditory white noise or“feel through” rough patches in some surfaces, causes the differences inthe reconstructed payload dimensions to be of the leastvalue/significance for perception, with respect to the intended use ofthe sensory signals.

No EM pathway conveys information perfectly from one place to another.The subject of the present disclosure introduces an LST that provides amethod for conveying sensory signals via inherently flawed EMpropagation mediums. For human viewing purposes, the claimed LST allowstransmitter equipment to transmit a representative signal to matchingreceiver equipment, under a broad diversity of information propagationconditions, that is reconstructed by the receiver into a viewableresult.

The subject of the present disclosure includes in one aspect the encoderassembly and decoder assembly for sampled payloads, wherein the sampleamplitudes may be represented either continuously (as pulsatile signals)or discretely (as digital signals). The method repeatedly constructsinput vectors from payload snippets, encodes input vectors as orderedseries of values to be made available, transports a signal bysimultaneously transmitting and receiving, decoding the ordered seriesof values received from the EM pathway into output vectors, anddistributing the output vectors as reconstructed payload snippets.

In one aspect, a method for collecting samples from input payloadsnippets into an input vector, encoding the input vector into an orderedseries of output values to be made available, and making available theoutput values for transmission through an imperfect medium comprises aseries of steps.

The first step of the method is collecting samples from the one or moreinput payload snippets into an indexed input vector of one predeterminedlength N. The predetermination of N involves a trade-off: Higher Nconfers greater throughput while sacrificing electrical resilience, allelse being equal. In an embodiment, N=32. This collecting step takesplace during a predetermined collecting interval, which might bedifferent from the intervals during which the other steps of the methodtake place, those other intervals comprising the encoding interval, thetransporting interval, the decoding interval, and the distributinginterval. In a preferred embodiment, all intervals are of commonduration.

This collecting step implements a predetermined permutation, which is aone-to-one mapping between indices in the set of input payload snippetsto indices in the input vector. The properties of the permutation do notmatter, such that any of the N! possible permutations is equallypreferred. In an embodiment, the input payload snippet samples areassigned to input vector locations in straightforward round-robin order.

A further step in the method associates with each input vector index aunique code, wherein each of the codes in the set is itself an indexedsequence of values, and wherein each of the codes is different from theother N−1 codes in the set, and wherein the lengths of the codes are allequal to another predetermined length L. The predetermination of Linvolves a trade-off: Higher L confers greater electrical resilience atthe expense of higher-speed circuit implementations. In an embodiment,L=128.

The next step of the method is the encoding step. The encoding stepiterates the encoding inner loop L times, all within a predeterminedencoding interval. There are L chip intervals for every encodinginterval, such that the duration of the chip interval=encodinginterval/L. The predetermination of the encoding interval isunconstrained. In a preferred embodiment, the encoding interval equalsthe transport interval.

The encoding step inner loop, executed once for each of the L indices inthe codes, comprises two sub-steps:

-   -   i. modulating each sample in the input vector by the value        addressed by the loop index in the corresponding code, and    -   ii. summing the results of all modulations of the prior sub-step        to form one of the ordered series of output values, and        wherein the ordered series of values resulting from the final        step, one value for each code index and, equivalently, for each        value of the loop index, in its entirety represents the input        vector.

The final step is the making available step. The making available stepinner loop, executed once for each of the L indices in the orderedseries of output values, comprises one sub-step:

-   -   i. making available the indexed one of the ordered series of        output values to an imperfect EM pathway.

The making available step takes place within the predetermined transportinterval, such that the duration of each inner loop iteration is equalto the duration of the transport interval divided by L. Thepredetermination of the transport interval depends, for example, upontrade-offs involving N, L, the energy density limits of the EM pathway,and the limits of the implementation technology: For fixed N and L, ashorter transport interval means higher payload throughput, at theexpense of higher-speed embodiments, all else being equal. In anembodiment, the transport interval is 100 ns, corresponding to 10million input vectors transported per second.

A preliminary step is to select values for N and L, each an integer ≥2.High L means high electrical resilience, but higher L demandshigher-speed circuits. High N means high payload throughput, but higherN means lower resilience, for fixed L. In an embodiment, N=128 andL=1024.

Another preliminary step is to select a set (“book”) of N Codes, one foreach index in the encoder input vector. A Code is a unique indexedsequence of L values. In a preferred embodiment, each of these Chips isa binary value, either +1 or −1, and each Code is DC-balanced. Each Codein the Code book is associated with a unique position in the inputvector. The first step in the method is to modulate the sample at eachindex in the vector by the correspondingly indexed value of the Codeassociated with that input vector index. Note that modulation can beaccomplished especially cost-effectively when the Chip is restricted to+1/−1 or +1/0.

The next step in the method is to sum the results of each modulation ofthe first step to form a value for transmission. An ordered series ofthese values is conveyed during the transport interval to represent theinput vector contents.

In a further aspect, each of the successive values produced by theencoding method is transmitted over an Imperfect Medium using a physicalmechanism.

In a further aspect, if the output value is made available fortransmission in digital form, then the method further includes a digitalto physical analog conversion of the value prior to transmission intothe EM pathway.

Note that these operations may be implemented either by digital circuitsor by analog circuits or by a combination thereof. In any case, thephysical transfer is electromagnetic propagation.

In an aspect, a method for receiving an ordered series of input valuescorresponding to a series of output values produced by a correspondingencoding method having been applied to one or more input payloadsnippets from an imperfect medium during a predetermined transportinterval, decoding the ordered series of input values into an outputvector, and distributing the output vector into one or morereconstructed payload snippets, comprises a series of steps.

The first step is to acquire synchronization with the signal arrivingfrom the imperfect medium. The literature on SSDS-CDMA systems containsmany methods and apparatus to acquire synchronization.

The next step is to prepare an output vector containing a predeterminednumber N of locations in which to develop the reconstructed samples.

The next step is to associate with each index in an output vector acode, from a predetermined code set, wherein each of the codes is anindexed sequence of values, or “chips.” Each code is different from eachof the other N−1 codes in the set. Also, each code is L chips long.Moreover, the code set is identical to the code set applied in thecorresponding encoding method. L and N for the decoding method match thecorresponding parameter values in the corresponding encoding method.

The next step is the receiving step. The receiving step takes placeduring the same transport interval in which the corresponding encodingmethod executes its making available step. The receiving step repeats aninner loop, executed once for each of the L indices in the orderedseries of input values, comprising one sub-step:

-   -   i. receiving the indexed one of the ordered series of output        values from an imperfect EM pathway.

The duration of each loop iteration is given by transport intervaldivided by L. The ordered series of input values produced by thereceiving step in its entirety represents the input payload snippetsthat were encoded by the corresponding encoding method and are to bereconstructed by this method.

The next step is the decoding step. The decoding step takes place duringa predetermined decoding interval. In a preferred embodiment, thedecoding interval equals the transport interval. The decoding stepexecutes L iterations of the following loop, one iteration for each ofthe L indices in the ordered input series:

-   -   i. modulating the indexed value in the ordered input series by        the commonly indexed value in the code corresponding to the        output vector index,    -   ii. summing the modulation result from sub-step i) 1) with the        correspondingly indexed element of the output vector,    -   iii. storing the summing result from sub-step i) 2) in the        corresponding output vector index, and    -   iv. tracking synchronization with the sending signal.

The final step is the distributing step. The distributing step takesplace during a predetermined distributing interval. In a preferredembodiment, the distributing interval equals the transport interval.This distributing step implements a predetermined permutation, which isa one-to-one mapping between indices in the output vector to indices inthe set of reconstructed payload snippets. The permutation is theinverse of the permutation applied in the corresponding encoding method.This decoder permutation presents zero or more samples from the outputvector to each reconstructed payload snippet.

In an aspect, an apparatus for constructing an input vector of samplesfrom one or more input payload snippets, encoding the input vector intoan ordered series of output values, and transmitting the ordered seriesof output values into an imperfect medium during a pre-determinedtransport interval, comprises a collection of elements.

One of the elements is a memory for receiving and storing all of thesamples in an input vector of a predetermined length N. Thepredetermination of N involves a trade-off: Higher N confers greaterthroughput while sacrificing electrical resilience, all else beingequal. In an embodiment, N=16.

Another element is a permuter. The permuter assigns input payloadsnippet samples to input vector locations. The permuter implements apre-determined permutation, which is also called a “one-to-one mapping.”There are N! possible such permutations. In a preferred embodiment, thepermutation is chosen for convenience.

Another element is a controller for repeating, for all N indices of theinput vector during a predetermined collecting interval, the step of:

-   -   Configuring the permuter to store the successive input payload        snippet sample to the indexed input vector location.

Another element is a set of N code generators for generating apredetermined set of codes. There is one code generator for each inputvector index. Each code in the code set is an indexed sequence ofvalues, or “chips.” The codes are all a common predetermined length L,such that there are L chips in each code. The predetermination of Linvolves a trade-off: Higher L confers greater electrical resilience, atthe expense of higher-speed circuit implementations. In an embodiment,L=1024. Each code is different from all the other codes in the set.

Another element is a set of N modulators. There is one modulatorcorresponding to each input vector index. Equivalently, there is onemodulator corresponding to each code in the code set. Each modulator hastwo inputs: One input comes is the corresponding input sample, while theother input is the corresponding chip.

Another element is a single N-input summer. The summer inputs are drivenby the modulator outputs, one per input vector index.

Another element is a controller for repeating, for all indices of theset of codes, at a rate sufficient to enumerate all indices of the setof codes within the predetermined encoding interval, the followingsteps:

-   -   modulating each element of the input vector with its        corresponding modulator by the value stored in the commonly        indexed position in the corresponding code, and summing with the        summer the results of all modulations of step g) i) to form the        indexed one in the ordered series of output values.

In a preferred embodiment, the encoding interval equals the transportinterval, such that each modulator can be seen directly to modulate itsinput sample by the corresponding code over the course of one encodinginterval.

Another element is an output terminal for making available the orderedseries of values created during the encoding interval.

Another element is a controller for repeating during the transportinterval, for each of the L indices in the ordered series of outputvalues, wherein the duration of each step is equal to the duration ofthe transport interval divided by L, the step of:

-   -   making available the indexed value in the ordered output series        created during the encoding interval at a rate sufficient to        enumerate all of the series indices within the transport        interval.

The ordered output series that has been made available after Literations of the foregoing making available step in its entiretyrepresents the input payload snippets.

In a further aspect, the values are transmitted over an imperfect EMpropagation pathway.

In a further aspect, the encoder assembly apparatus varies theseparameters under algorithmic control, for example to accommodate changesin the nature of the payload, the EM pathway propagationcharacteristics, or the application requirements.

In an aspect, an apparatus for receiving an ordered series of inputvalues corresponding to an ordered series of output values produced by acorresponding encoding apparatus having been applied to one or moreinput payload snippets from an imperfect medium during a predeterminedtransport interval, decoding the ordered series of input values into anoutput vector of samples, and distributing the output vector as one ormore reconstructed payload snippets, comprises a collection of elements.

One of the elements is a memory for reconstructing and storing all ofthe samples in an output vector of a predetermined length N, whichequals the N of the corresponding encoding apparatus.

One of the elements is a set of code generators. There are N codegenerators, one for each output vector index. Each code generatorproduces a predetermined code, which is an indexed sequence of values,or “chips.” Each code in the code set is another predetermined length L,which equals the L of the corresponding encoding apparatus. Each code isdifferent from all the other codes in the set. The code set is identicalto the code set of the corresponding encoding apparatus.

Another of elements is a set of N correlators. There is one correlatorcorresponding to each output vector index and, equivalently, onecorrelator corresponding to each code in the code set. Each correlatorhas two inputs: One input is the received input value, and the otherinput is the corresponding chip.

One of the elements is a set of N summing circuits, There is one summingcircuit associated with each output vector index. Each summing circuithas two inputs: One input is the output of the corresponding correlator,and the other is the content of the correspondingly indexed outputvector location.

One of the elements is a synchronization acquisition and trackingcircuit. The synchronization and acquisition circuit comprises a clockrecovery circuit and a correlation spike detector.

One of the elements is a controller for repeating during the transportinterval, for each of the L indices in the ordered series of inputvalues, the steps of:

-   -   i. configuring the synchronization acquisition and tracking        circuit to infer reference clock frequency and phase by        analyzing the signal arriving from the imperfect medium, and    -   ii. receiving the indexed value in the ordered input series at a        rate sufficient to enumerate all of the series indices within        the transport interval.

The ordered input series that has been received after L iterations ofthe foregoing receiving loop has completed in its entirety representsthe payload snippets to be reconstructed.

The duration of each step in the receiving loop is equal to the durationof the transport interval divided by L.

Another of the elements is a controller for repeating, during apredetermined decoding interval, for each of the L indices in theordered series of input values, the step of:

-   -   repeating, for each of the N indices in the output vector, the        sub-steps of:    -   i. configuring the indexed correlator to contribute a portion of        the indexed output sample by correlating the received input        value by the commonly indexed value in the indexed code,    -   ii. configuring the indexed summing circuit to sum the output of        the indexed correlator with the content of the indexed output        vector location, and    -   iii. configuring the correspondingly indexed location in the        output vector memory to receive the output of the summing        circuit.

One of the elements is a controller for repeating, during apredetermined distributing interval, for each of the N indices in theoutput vector, the steps of:

-   -   i. configuring the synchronization acquisition and tracking        circuit to infer reference clock frequency and phase by        analyzing the signal arriving from the imperfect medium, and    -   ii. receiving the indexed value in the ordered input series at a        rate sufficient to enumerate all of the series indices within        the transport interval.

The ordered input series that has been received after completion of Literations of the inner loop above in its entirety represents thepayload snippets to be reconstructed.

One of the elements is a controller for repeating during a predetermineddistributing interval, for all N indices of the output vector, the stepof:

-   -   i. configuring the permuter to make available the indexed output        vector location as the successive reconstructed payload snippet        sample.

In a further aspect, the ordered series of input values is received overan imperfect electromagnetic propagation pathway.

In another aspect, what is claimed is an LST incorporating an encoderassembly apparatus paired with a corresponding decoder assemblyapparatus.

In a further aspect, an LST incorporating an encoding apparatusconfigured for carrying digital signals is paired with a decodingapparatus configured for carrying digital signals.

In a further aspect, an LST incorporating an encoding apparatusconfigured for carrying pulsatile signals is paired with a decodingapparatus configured for carrying digital signals.

In a further aspect, an LST incorporating an encoding apparatusconfigured for carrying digital signals is paired with a decodingapparatus configured for carrying pulsatile signals.

In a further aspect, an LST incorporating an encoding apparatusconfigured for carrying pulsatile signals is paired with a decodingapparatus configured for carrying pulsatile signals.

Those of skill in the art would understand that information and signalsmay be represented using any of a variety of technologies andtechniques. For example, data, instructions, commands, information,signals, bits, samples, symbols, and chips may be referenced throughoutthe above description may be represented by voltages, currents,electromagnetic waves, magnetic fields or particles, optical fields orparticles, or any combination thereof.

Those of skill in the art would further appreciate that the variousillustrative logical blocks, modules, circuits, and algorithm stepsdescribed in connection with the embodiments disclosed herein may beimplemented as electronic hardware, computer software or instructions,or combinations of both. To clearly illustrate this interchangeabilityof hardware and software, various illustrative components, blocks,modules, circuits, and steps have been described above generally interms of their functionality. Whether such functionality is implementedas hardware or software depends upon the particular application anddesign constraints imposed on the overall system. Skilled artisans mayimplement the described functionality in varying ways for eachparticular application, but such implementation decisions should not beinterpreted as causing a departure from the scope of the presentinvention.

The steps of a method or algorithm described in connection with theembodiments disclosed herein may be embodied directly in hardware, in asoftware module executed by a processor, or in a combination of the two.For a hardware implementation, processing may be implemented within oneor more application specific integrated circuits (ASICs), digital signalprocessors (DSPs), digital signal processing devices (DSPDs),programmable logic devices (PLDs), field programmable gate arrays(FPGAs), processors, controllers, micro-controllers, microprocessors,other electronic units designed to perform the functions describedherein, or a combination thereof. Software modules, also known ascomputer programs, computer codes, or instructions, may contain a numbera number of source code or object code segments or instructions, and mayreside in any computer readable medium such as a RAM memory, flashmemory, ROM memory, EPROM memory, registers, hard disk, a removabledisk, a CD-ROM, a DVD-ROM, a Blu-ray disc, or any other form of computerreadable medium. In some aspects the computer-readable media maycomprise non-transitory computer-readable media (e.g., tangible media).In addition, for other aspects computer-readable media may comprisetransitory computer-readable media (e.g., a signal). Combinations of theabove should also be included within the scope of computer-readablemedia. In another aspect, the computer readable medium may be integralto the processor. The processor and the computer readable medium mayreside in an ASIC or related device. The software codes may be stored ina memory unit and the processor may be configured to execute them. Thememory unit may be implemented within the processor or external to theprocessor, in which case it can be communicatively coupled to theprocessor via various means as is known in the art.

Further, it should be appreciated that modules and/or other appropriatemeans for performing the methods and techniques described herein can bedownloaded and/or otherwise obtained by computing device. For example,such a device can be coupled to a server to facilitate the transfer ofmeans for performing the methods described herein. Alternatively,various methods described herein can be provided via storage means(e.g., RAM, ROM, a physical storage medium such as a compact disc (CD)or floppy disk, etc.), such that a computing device can obtain thevarious methods upon coupling or providing the storage means to thedevice. Moreover, any other suitable technique for providing the methodsand techniques described herein to a device can be utilized.

In one form the invention may comprise a computer program product forperforming the method or operations presented herein. For example, sucha computer program product may comprise a computer (or processor)readable medium having instructions stored (and/or encoded) thereon, theinstructions being executable by one or more processors to perform theoperations described herein. For certain aspects, the computer programproduct may include packaging material.

The methods disclosed herein comprise one or more steps or actions forachieving the described method. The method steps and/or actions may beinterchanged with one another without departing from the scope of theclaims. In other words, unless a specific order of steps or actions isspecified, the order and/or use of specific steps and/or actions may bemodified without departing from the scope of the claims.

As used herein, the term “determining” encompasses a wide variety ofactions. For example, “determining” may include calculating, computing,processing, deriving, investigating, looking up (e.g., looking up in atable, a database or another data structure), ascertaining and the like.Also, “determining” may include receiving (e.g., receiving information),accessing (e.g., accessing data in a memory) and the like. Also,“determining” may include resolving, selecting, choosing, establishingand the like.

The system may be a computer implemented system comprising of a displaydevice, a processor and a memory and an input device. The memory maycomprise instructions to cause the processor to execute a methoddescribed herein. The processor memory and display device may beincluded in a standard computing device, such as a desktop computer, aportable computing device such as a laptop computer or tablet, or theymay be included in a customised device or system. The computing devicemay be a unitary computing or programmable device, or a distributeddevice comprising several components operatively (or functionally)connected via wired or wireless connections. An embodiment of acomputing device comprises a central processing unit (CPU), a memory, adisplay apparatus, and may include an input device such as keyboard,mouse, etc. The CPU comprises an Input/Output Interface, an Arithmeticand Logic Unit (ALU) and a Control Unit and Program Counter elementwhich is in communication with input and output devices (eg input deviceand display apparatus) through the Input/Output Interface. TheInput/Output Interface may comprise a network interface and/orcommunications module for communicating with an equivalentcommunications module in another device using a predefinedcommunications protocol (e.g. Bluetooth, Zigbee, IEEE 802.15, IEEE802.11, TCP/IP, UDP, etc). A graphical processing unit (GPU) may also beincluded. The display apparatus may comprise a flat screen display (egLCD, LED, plasma, touch screen, etc), a projector, CRT, etc. Thecomputing device may comprise a single CPU (core) or multiple CPU's(multiple core), or multiple processors. The computing device may use aparallel processor, a vector processor, or be a distributed computingdevice. The memory is operatively coupled to the processor(s) and maycomprise RAM and ROM components, and may be provided within or externalto the device. The memory may be used to store the operating system andadditional software modules or instructions. The processor(s) may beconfigured to load and executed the software modules or instructionsstored in the memory.

BRIEF DESCRIPTIONS OF FIGURES

FIG. 1 depicts a method for collecting an input vector from a set ofpayload snippets, encoding the vector as an ordered series of outputvalues, and making available the output values for transmission over animperfect EM pathway;

FIG. 2 depicts a method for decoding receiving an ordered series ofinput values from an imperfect EM pathway, decoding the input series toform an output vector, and distributing the output vector toreconstructed payload snippets;

FIG. 3 illustrates a local-site transport for snippets from one or morepayload signals;

FIG. 4 describes one particular permutation, the permutation being amapping from input payload snippet indices to encoder input vectorindices, the example shown being round-robin assignment;

FIG. 5 illustrates an example round-robin permutation from indices insnippets of a parallel-RGB input video signal to indices in an 8-elementencoder input vector, for the first transport interval for a givenpayload;

FIG. 6 further illustrates the example round-robin permutation fromindices in snippets of a parallel-RGB input video signal to indices inan 8-element encoder input vector, for the second transport interval forthe given payload;

FIG. 7 shows an apparatus for encoding an N-sample input vector as anL-time-interval series of output values that are transmitted;

FIG. 8 depicts an example of a commutating modulator;

FIG. 9 illustrates an apparatus for decoding an N-sample output vectorfrom an L-time-interval series of input values that are received;

FIG. 10 shows the architecture of one synchronization acquisition andtracking circuit;

FIG. 11 shows the architecture of an alternative synchronizationacquisition and tracking circuit;

FIG. 12 describes one particular round-robin assignment of decoderoutput vector indices to snippets of reconstructed payload signals;

FIG. 13 illustrates an example round-robin permutation from indices inan 8-element decoder output vector to indices in snippets of areconstructed parallel-RGB output video signal, for the first transportinterval for a given payload;

FIG. 14 further illustrates the example round-robin permutation fromindices in an 8-element decoder output vector to indices in snippets ofa reconstructed parallel-RGB output video signal, for the secondtransport interval;

FIG. 15 shows the schema of one binary Code Book that is a subset of theidentity matrix;

FIG. 16 shows an example of a 127×127 binary code book whose codes iseach a unique rotation of a common PN sequence;

FIG. 17 shows an example of a 128×128 binary code book, which is aWalsh-Hadamard matrix;

FIG. 18 shows an example of a 128×128 binary code book, which isconstructed by element-wise multiplying each row of a Walsh-Hadamardmatrix with a common near-PN sequence;

FIG. 19 depicts the interconnections amongst the constituents of asignal collection, processing, and presentation system; and

FIG. 20 shows an example oscilloscope trace of a signal arriving fromthe EM pathway at the decoder assembly input terminal.

GLOSSARY

Terms relating to the widely understood Spread Spectrum transmissionsystem are defined and elaborated upon in “Spread Spectrum Systems withCommercial Applications” by Robert C. Dixon, volume 3, Wiley & Sons1994.

-   Signal A fluctuating quantity conveying information-   Sensory Signal A signal capable of being interpreted by the human    neural system (for example, light for the eyes, sound for the ears,    pressure for the touch, chemicals for the taste, etc.)-   Perception The brain's awareness, comprehension, or understanding of    a received sensory signal-   Color Space An abstract mathematical model, which describes a color    gamut as tuples of numbers, typically as 3 or 4 components (examples    include RGB, YUV, YCbCr, and CMYK)-   Color Value A signal amplitude corresponding to a basis vector in a    color space-   Pixel A mathematical object associated with a geometric location in    a 2D plane; a pixel is completely described as a set of Color    Values, equivalently, a vector in a color space-   Image A 2-dimensional array of Color Values-   Video A sequence of Images in a predetermined electronic format    which, when presented to a human viewer with sufficient rapidity,    induces perception of motion and continuity-   “analog” Representation of a Signal    -   A physical quantity. Physical quantities change continuously        over time, and the number of different amplitudes available is        limited by our ability to measure energy. Examples of analog        representations of a signal include:    -   Image sensor: Capacitance    -   (at each “pixel” in the sensor: conditionally discharge a        capacitor through a photodiode for a predetermined exposure        interval; the brighter that portion of the focal area, the less        charge remains in the capacitor after the exposure interval)    -   LED/LCD display: current    -   (the brightness of each “pixel” in the display (the smallest        controllable portion) is determined by a control current any        given moment)-   “digital” Representation of a Signal    -   A number that changes at predetermined intervals. Examples of        digital representations of a signal include:    -   PC: An R or G or B entry in a TIF file    -   Serial digital Interface: An ordered series of bits in a        predetermined format-   N Number of elements in an encoder input vector and the    corresponding decoder output vector . . . >1-   L The common number of Chips in each code, equivalently, the number    of Chip intervals applied during each encoding interval or decoding    interval. N can be any counting number. The bigger L is than N, the    more electrical resilience is afforded to the conveyed payload-   Payload The set of sampled signals that is the subject of transport-   Snippet A finite, ordered series of successive samples from a signal-   (Input or Output) Vector    -   A finite, ordered series of samples collected from, or        distributed to, payload snippets. The vector comprises N values.-   Imperfect Medium A physical electromagnetic (EM) propagation pathway    and its environment, which combine to cause received values not to    equal transmitted values, thus creating errors-   EM Pathway Imperfect medium. The subject of this disclosure probably    works best with waveguides, because it relies on using all bandwidth    and dynamic range available in the EM pathway-   Waveguide An EM pathway that physically constrains and confines the    EM propagation vectors-   Code A pre-determined sequence of Chips that is L Chips long.-   Chip A value from a predetermined set of possible values.-   Chip Interval The period of time allocated for the application of    one Chip in the encoder or decoder. Encoder Chip interval=encoding    interval/L, and decoder Chip interval=decoding interval/L-   Transport interval The period of time allocated for simultaneously    transmitting and receiving EM propagation across the EM pathway-   Binary Code a Code wherein the Chips are binary values-   Binary Chip The possible values are −1 or +1. (One might expect 0 or    +1. Binary Chip values are −1 and +1 so as to facilitate balanced    direct sequence modulation.)-   PN Sequence A (Binary?) Code whose output exhibits spectral    characteristics similar to those of white noise. “PN” stands for    “Pseudo Noise.” An ideal PN Sequence's signal energy is uniform    across the transmission spectrum; such that its Fourier Transform    looks like a fine-tooth comb, with equal energy at every frequency.    (NB: Not all Codes are PN Sequences)-   Spreading A property of individual Codes, and the effect of    modulating a signal by a PN Sequence: A signal modulated by an ideal    PN Sequence exhibits spectral characteristics similar to those of    white noise-   Spreading Code PN Sequence (NB: Not all PN Sequences “spread”    ideally)-   Spreading Ratio=L    -   =The number of successive Chips modulating each input sample    -   =The number of successive Chips demodulating the ordered series        of received values to decode the output vector    -   =Spreading Factor (Dixon uses the terms “Spreading Ratio” and        “Spreading Factor” interchangeably)    -   =SSDS process gain    -   =Code length    -   =Chip sequence length    -   =The number of encoder Chips modulating each sample in the input        vector    -   =The number of decoder Chip correlations contributing to each        sample in the output vector-   Orthogonality A property of sets of Codes (“Code Books”). A Code    Book is considered orthogonal if all of its N codes are pair-wise    uncorrelated and independent sequences. (An orthogonal Code Book    minimize inter-track interference among N tracks.)-   Walsh-Hadamard Code Set A set of PN Sequences wherein each Code    constitutes an orthonormal basis vector for the L-dimensional space    of Codes. For any two Codes in the set, the cross product is 0,    representing nil cross-correlation. For any Code in the set, the    self-product is 1, representing 100% auto-correlation.

DETAILED DESCRIPTION OF EMBODIMENTS

The embodiments provided disclose ways in which certain methods andapparatus are used and useable in a range of environments.

An embodiment of an encoding method and apparatus is depicted in FIG. 1wherein the method repeats, for each Chip interval τ and, equivalently,for each common index in the Codes of a predetermined code book ofindexed Chips, the steps of the method comprise but are not limited tothe steps of:

-   -   i) Modulating 308 each input sample 300 by the commonly indexed        Chip 104 in the Code 304 corresponding to the index in the input        vector 350. If the payload signals are pulsatile, then the        samples are continuous values and an embodiment of modulation is        an analog multiplication. If the Codes are binary (1/−1), then        an embodiment of analog modulation is a conditional inversion.        If the payload signals are digital, then the samples are numbers        and an embodiment of modulation is a digital multiplier. If the        Codes are binary (1/−1), then an embodiment of the digital        multiplier is a conditional negation;    -   ii) Summing 310 the modulation results 114 from step i) to form        one of the ordered series 110 of output values 112 for        transmission. If the payload signals are pulsatile, then the        modulation results are continuous values and the summing is a        summing circuit. If the payload signals are digital, then the        modulation results are numbers, and the summing is an adder;    -   iii) Making available the output 108 produced by step ii), at a        rate sufficient to enumerate all of the code 304 indices within        the Encoding Interval 12. The making available is achieved in        many ways, one example is to provide the output on a port,        another alternative is to store the output into a memory upon        which a reading can be executed to make the output available.

By following the steps disclosed to produce one value for each code 304index during each chip interval τ during the encoding interval 12, theordered series 110 of values 112 resulting from step iii) represents theinput vector 350. This process is achieved for each encoding interval,such that the method described can be repeated for successive inputvectors.

In a preferred embodiment of the method of FIG. 1, the code book 354 isa set of N mutually orthogonal L-Chip 104 Codes 304, each of which is aSpreading Code. The L indices of the Codes correspond to the L chipintervals τ allocated during the encoding interval. The ratio L/N is the“SSDS Process Gain” as defined by Dixon on p. 6. This ratio captures atrade-off wherein the electrical resilience conferred to each sample inthe input vector grows with the ratio between L and N. Availableimplementation technology places an upper limit on L. The larger N, thehigher the bandwidth of payloads that can be accommodated. A designer istherefore motivated to make N very large. However, fixed L means thatincreasing N decreases the electrical resilience conferred to eachsample in the input vector. In a preferred embodiment, L≥N.

The encoding method of FIG. 1 repeats, for each chip interval τ and,equivalently, for each common index in the Codes, the steps of:

-   -   i) modulating 308 each input sample 300 by the commonly indexed        Chip 104 in the Code 304 corresponding to the input signal        value's index in the input vector 350. If the payload signals        are pulsatile, then the samples are continuous values and an        embodiment of modulating is analog multiplication. If the Codes        are binary (1/−1), then an embodiment of analog multiplication        is conditional inversion. If the payload signals are digital,        then the samples are numbers and an embodiment of modulating is        digital multiplication. If the Codes are binary (1/−1), then an        embodiment of digital multiplication is conditional negation,    -   ii) summing 310 the modulation results 114 from step i) to form        one of the ordered series 110 of output values 112, and    -   iii) making available the output 108 produced by step ii), at a        rate sufficient to enumerate all of the code 304 indices within        the predetermined encoding interval,        wherein the ordered series 110 of values 112 resulting from step        iii), one value for each code 304 index, in its entirety        represents the input vector 350 within the predetermined number        L of chip intervals τ.

Only the signals appearing entirely within the high-speed time domainindicator 506 in FIG. 1 change during the process of encoding the inputvector 350.

FIG. 2 depicts a receiving, decoding, and distributing method andapparatus for reconstructing payload snippets from a received waveform,wherein an L-chip-interval time series 216 of received values 214 isdecoded to yield an N-element output vector 352 of output signal samples302. A full set of output values is produced once, after the L chipintervals τ allocated to receive the output vector 352.

The decoding method of FIG. 2 relies on a code book 356. The code bookis a set of N mutually orthogonal L-Chip 206 Codes 202, each of whichshould probably be a Spreading Code. The L indices of the Codescorrespond to the L chip intervals τ allocated to receive the outputvector 352.

At the beginning of each decoding cycle (on

0), initialize the output values 302 each to 0.

During each chip interval τ, the received value 214 is correlated 334 bythe correspondingly indexed Chip 206 of the Code 202 whose index in thecode book 356 corresponds to the index of the output value 302 in theoutput vector 352. If the payload signals are pulsatile, then thesamples are continuous values and an embodiment of correlating is analogmultiplication. If the Codes are binary (1/−1), then an embodiment ofanalog multiplication is conditional inversion. If the payload signalsare digital, then the samples are numbers and an embodiment ofcorrelating is digital multiplication. If the Codes are binary (1/−1),then an embodiment of digital multiplication is conditional negation.

All L correlation results 204 at each input vector 350 index are summed336 over the course of the encoding interval 2 to yield the respectiveoutput sample 302.

The output vector 352 contains the reconstructed payload samples afterthe L chip intervals τ allocated to receive the output vector and makesthem available as output vector values 344. The making available isadapted to any form of intra-equipment signalling.

Only the signals appearing entirely within the high-speed time domainindicator 506 in FIG. 2 change during the process of encoding the outputvector 352.

Local-Site Transport of sample signals involves repeating this sequenceof steps, potentially endlessly:

-   -   Assembling an Input Vector from Input Payload Snippets;    -   Encoding the Input Vector into a Transmitted Signal under        control of Code Book;    -   Transporting the Signal, which involves two concurrent        activities;        -   Transmitting the Signal (in the encoder assembly 326), and        -   Receiving the Signal (in the decoder assembly 328);    -   Decoding the Received Signal into the Output Vector, under        control of the Code Book; and    -   Distributing the Output Vector into Reconstructed Payload        Snippets.

Referring now to FIG. 3, element 1 represents end-to-end local-sitetransport (LST) 1 for sampled payloads includes an encoder assembly 326connected over an electromagnetic (EM) pathway 314 to a decoder assembly328. The encoder assembly receives an ordered series 350 of inputsamples 504 and produces an analog waveform on the EM pathway. Thedecoder assembly receives an analog waveform from the EM pathway andproduces an ordered series 352 of output values 344, each of which is anapproximation of its corresponding payload value. All of the encodingand decoding operations take place over the L steps of a predeterminedtransport interval, within the indicated high-speed time domain 506. Inan embodiment, the EM pathway is a waveguide, enabling the maximumamount of energy to be conveyed.

An encoder input vector 350 is assembled from successive samples 504from each of one or more input payload signals 500 over a collectinginterval 100 according to an arbitrary, pre-determined bijective encodermapping function 346. The corresponding output payload signals 502 areassembled over a distributing interval 102 from the decoder output valuevector 352 by a bijective decoder mapping function 348. In a preferredembodiment, the decoder mapping function is the inverse of thecorresponding encoder mapping function.

The encoder assembly 326 transforms the encoder input vector 350 into aseries of values transmitted via the EM pathway 314 to the decoderassembly 328. The EM pathway connects the encoder assembly outputterminal 338 to the decoder assembly input terminal 340. An impedance316 terminates the EM pathway at the decoder assembly input terminal.The decoder assembly receives the propagated signal from the EM pathwayand transforms the sequence of received values into the decoder outputvector 352.

The LST 1 shown in FIG. 3 is capable of injecting relatively largeamounts of mains-supplied energy into the EM pathway 314. In anembodiment, the EM pathway is a waveguide.

Without loss of generality, it is apparent to one skilled in the artthat while the system is described as transporting payloads from encoderassembly 326 to decoder assembly 328 that information may also flow inthe opposite direction over the EM pathway 314 with the implementationof a secondary decoder parallel to primary encoder 326 and attached tothe transmission medium at 338 receiving information from a secondaryencoder block parallel to primary decoder 328 and driving the line at340 to implement bi-directional transmission of information, eitherdigital or pulsatile. The primary distinction of primary vs. secondaryencoder/decoder is a distinction of amount of information flow. Thesecondary information flow being for example command and controlsignals, audio signals to drive a speaker or similar apparatus. This isknown as UTC (Up The Cable) communications and is comprised of muchlower information content. With the use of a separate code sequence forthe UTC communications the information in the form of digital orpulsatile signals may flow in the opposite direction, such separate codesequence being orthogonal to the primary code sequences.

FIG. 4 illustrates one of the N! possible permutations of the permuter346 between Collection Interval 500 samples 504 and encoder input vector350 positions 300. This schema allows for any number of payload signalsin the list implied by the ellipses between β and ω on the left-handside of the drawing, and for each payload signal to contribute anynumber of samples from its snippet to the input vector during eachCollection Interval.

FIG. 4 shows a straightforward round-robin permutation performed withinthe permuter 346, wherein a next sample from each signal 500 in the setof payload signals 504 α, β, . . . , ω is assigned in turn to the nextavailable index in the encoder input vector 350, until all N inputvector locations 300 have been filled. The numbered circles indicate theorder in which the input payload snippet samples are selected forincluding in the encoder input vector. Exactly N samples are collectedduring the Collection Interval.

Although there are N! equally good choices for permutation implementedby the permuter 346, the decoder permuter 348 implements the inverse ofthe permutation implemented by the corresponding encoder. Ensuringagreement regarding such details is the subject of internationalstandards, for future implementation.

The schema drawn in FIG. 4 applies to many possible types of signal. Forexample, there could be a single payload signal, consisting of arepresentation of video wherein each successive sample is a color value(for example, 3 (R/G/B) per pixel). Another example is also a singlepayload signal, this one payload signal consisting of color values fromseveral interleaved independent video signals. Further examples includediverse types of signal, for example, video, audio, chemical,mechanical/haptic, and so forth. An embodiment of one such hybridexample includes different numbers of samples from/to each payloadsignal during each transport interval. Further examples include each ofthe four types of signal (digital, analog, pulsatile, and neural) soloor in concert.

FIG. 5 illustrates an especially common special case of the generalschema described in FIG. 4. In this example, the payload consists of 3signals 500, representing the R, G, and B color planes, respectively, ofa single RGB-based video signal. N, the number of elements in theencoder input vector 350, happens to be 8. This example shows theround-robin assignment during the transmission of a first transportinterval.

Further to the example begun in FIG. 5, FIG. 6 illustrates round-robinassignment during the transmission of the second transport interval.

Referring now to FIG. 7, an encoder assembly 326 receives input signalsamples 504 from mapping 346 and drives a signal through its outputterminal 338 onto an EM pathway 314. The encoder assembly includes aninput vector memory 326 for receiving and storing all of the inputsignal samples and a Code Book memory 354 for receiving and storing apredetermined code set, one Code 304 associated with each input sample300.

The encoder assembly 326 data path features a plurality of modulators308, one per input sample 300, which is re-used over and over, once perchip interval τ. On each cycle of the transmit clock in the high-speeddomain 506, each modulator applies the correspondingly indexed Chip 306to its correspondingly indexed input sample, and the summing circuit 310combines all modulator outputs 508 to produce a next value 108 fortransmission by the line driver 312 via the output terminal 338 into theEM pathway 314. In an embodiment, the EM pathway is a waveguide,enabling the maximum amount of energy to be conveyed.

If the input payload signals 500 are pulsatile, then the input samples301 are continuous values and an embodiment of the modulator 308 is ananalog multiplier. If the Codes 330 are binary (1/−1), then anembodiment of the analog modulator is a conditional inverter. If thepayload signals are digital, then the samples are numbers and anembodiment of the modulator is a digital multiplier. If the Codes arebinary (1/−1), then an embodiment of the digital multiplier is aconditional negater.

An application payload signal 500 of longer duration than a singlecollecting interval 100 is encoded over the course of several collectingintervals and thus over the course of a corresponding number of encodingintervals 12 as well as a corresponding number of transport intervals 2.In a preferred embodiment, the parameters defining the encoder assembly326, including collecting interval, encoding interval, transportinterval, N 8, L 10, code book 354, and permuter 346 permutation allremain constant throughout the steps involved in the processing of oneset of input payload samples 504 corresponding to a single set of inputvector 350 contents. In one embodiment of the encoder assembly, all ofthe encoding parameters are “hard coded” and cannot be changed. Becausethe encoding of one input vector is logically independent from theencodings of all previous and of all following input vectors, theencoding parameters may change from one input vector's worth of payloadsamples to the next. Therefore, in another embodiment of the encoderassembly, any of the encoding parameters may be varied from onecollecting interval to the next under algorithmic control, for examplein response to changes in payload characteristics, EM pathway 314characteristics, and/or application requirements.

For a digital embodiment of the encoder modulator 308 wherein theencoder Chips 306 happen to be constrained to be binary (for example, 1and 0), one embodiment of the modulator comprises a combinatorialcircuit that inverts the signed integer representation of each inputsample 342. A corresponding embodiment of the line driver 312 effects adigital to analog conversion.

For an analog embodiment of the encoder modulator 308 wherein theencoder Chips 306 happen to be constrained to be binary (for example, 1and −1), one modulator embodiment comprises a commutating modulator,such as the example shown in FIG. 8.

The example modulator 308 shown in FIG. 8 applies the Chip input 104 tothe corresponding input sample 342 to produce modulated output 508. Thisstyle of modulator, known as a commutating modulator, inverts the inputsample 342 based upon the polarity of the Chip input 104. Coupledinductors 606 and 608 impose a galvanically isolated copy of the inputsample 342 across commutation diodes 612 and 610 relative to a centertap connected to signal 602, each of diodes 612 and 610 conduct in turnbased upon the polarity of bias imposed by signal 626. The Chip input104 imposes a differential signal to the center tap of inductor 608, andone of the terminals of inductor 608 through signal 628. In one of thetwo differential polarities of Chip input 104, current flows throughinductor 622 to signal 626, then through forward biased diode 612 intoinductor 608, out of the center tap of inductor 608 onto signal 602,through inductor 616 to complete the current loop, according toKirchhoff's circuital laws. On the opposite polarity of Chip input 104,current flows through inductor 616 to signal 602 and thereby onto thecenter tap of inductor 608. The signal emerges from inductor 608 andflows through forward biased diode 610 and onto signal 626, whereuponthe current travels back through inductor 622 thus again completing thecurrent loop according to Kirchhoff's circuital laws. It should be notedthat the circuit direction in these two cases flows in oppositedirections. Capacitors 618 and 620 are DC removal capacitors that ensurethat the direction of current flow in signal 628 is converted correctlyto a positive or negative polarity and biases the inductor 608accordingly. Input sample 342 is coupled onto the above mentionedbiasing signal flows. This coupled signal then flows out of coupledinductor 608 and through one of two established paths originating fromthe center tap 602 and exiting from one or the other of the terminals ofinductor 608, there by establishing positive and negative signalrepresentation through polarity of biasing signal imposed on 626.Capacitor 614 is a DC blocking capacitor that removes DC components fromoutput signal 624.

Referring now to FIG. 9, a decoder assembly 328 receives a signal fromthe EM pathway 314 at its input terminal 340. In an embodiment, the EMpathway is a waveguide, enabling the maximum amount of energy to beconveyed. The EM pathway is terminated by terminating impedance 316. Thesignal entering the decoder assembly is received by line amplifier 322,which is controlled through a feedback path by an equalizer 324.

The output vector 352 is developed by the decoder 512 over the course ofthe decoding interval by accumulating partial contributions in thestorage elements 302 during each chip interval 500 of the concurrenthigh-speed operations taking place inside of area 506. For each outputvector 352 index, the decoder assembly 328 also comprises one Code 330at a corresponding index in the Code Book memory 356, one correlator334, and one integrator 336.

Before beginning to decode an ordered series of received values, theoutput vector 352 entries 302 are cleared (by storing the value 0 ineach. Subsequently, during each predetermined chip interval τ allocatedto decoding the output vector, for each output vector index, correlateusing the correlator 334 the received value 214 produced by lineamplifier 322 with the correspondingly indexed Chip 332, and gatherusing the summing circuit 336 the correlation result 702 with thecontents of the corresponding output sample memory 302.

For a digital embodiment of the decoder 512 wherein the Chips 332 happento be constrained to be binary (for example, 1 and 0), one embodiment ofa correlator 334 comprises a combinatorial circuit that inverts thesigned integer representation of each received value 342 according tothe Chip 332. A corresponding embodiment of the line driver 312 effectsa digital to analog conversion.

For an analog embodiment of the decoder 512 wherein the Chips happen tobe constrained to be binary (for example, 1 and −1), a correlator mightconsist of an analog modulator, such as the example shown in FIG. 8.

The output of each correlator 334 is integrated, together with thecontents of its corresponding output sample memory 302, by thecorresponding integrator 336. For a digital embodiment of the decoder,the integrator might be a straightforward combinatorial adder.

For an analog embodiment of the decoder, one embodiment of an integratorcomprises an op-amp-based integrator.

If the reconstructed payload signals 502 are pulsatile, then the outputsamples 303 are continuous values and an embodiment of the correlator334 is an analog multiplier. If the Codes 332 are binary (1/−1), then anembodiment of the analog correlator is a conditional inverter. If thepayload signals are digital, then the samples are numbers and anembodiment of the correlator is a digital multiplier. If the Codes arebinary (1/−1), then an embodiment of the digital correlator is aconditional negater.

The correlation spike detector 320 monitors the outputs of the array ofdecoder correlators 334. In one embodiment all decoder assembly 328functional elements are synchronized by a clock recovery circuit 318,which monitors the output of the line amplifier 322 as well as theoutput of the correlation spike detector to acquire and track carriersynchronization.

SSDS is different from what is claimed in this disclosure:

-   -   SSDS is a technology for communicating over long distances,        versus the relatively limited distances spanned by LSTs.    -   SSDS is applied when nearly every bit of a digital signal must        be conveyed correctly, versus the satisficing approximations        actually required of LSTs for many applications, including most        human-viewing applications.    -   SSDS is generally applied for single signal streams through an        EM pathway which is often in free space, whereas LST carries one        payload through an EM pathway which is often a waveguide.

SSDS-CDMA is different from what is taught in this disclosure:

-   -   In prior SSDS-CDMA, the encoded values are transmitted        asynchronously from one another; by contrast, the LST disclosed        herein synchronously encodes all values in a vector of N payload        signal sample values as a series of L values conveyed across the        EM pathway.    -   Prior SSDS-CDMA seeks to hide the transmitted signals in the        ambient noise floor, for minimum energy consumption, minimum        potentially harmful EM radiation, and minimum probability of        intercept; by contrast, the LST disclosed herein sends the        maximum energy into the EM pathway that is permitted by relevant        FCC/CE/CCC regulations.    -   Prior (bit-serial) SSDS-CDMA relies on Chip-phase-shifted Code        variants to differentiate amongst transmitters; by contrast, the        encoder and decoder pair claimed herein uses orthogonal Code        Books to minimize Intertrack Interference (II).        -   An orthogonal Code Book may contain non-spreading Codes. The            Identity matrix (sketched in FIG. 15) is an example of one            such Code Book.        -   One embodiment of an orthogonal Code Book contains spreading            Codes, such that 1) transmission of each input/output vector            sample enjoys the resiliency benefits of SSDS against            aggressors and 2) for signals destined for sensory            perception, transforming electrical imperfections as well as            any II into perceptually benign artifacts.            Acquisition and Tracking of Synchronization Information in            SSDS-CDMA Systems

In any SSDS communication system, the receiver needs to be synchronizedwith the transmitter. Typically, the synchronization takes place in twoparts: an initial coarse synchronization, also known as acquisition,followed by a finer synchronization, also known as tracking. There aremany sources of error in the acquisition of synchronization, however inthe embodiments disclosed herein, application issues of Doppler shift,multipath interference and some of the subtler effects which impactprior SSDS-CDMA are not present due to the relatively constrained natureof most infrastructure EM pathways.

There is an additional benefit in which the initial chip rate, alsoknown as the repeat rate, during the transport interval will becontrolled by crystal oscillators or other accurate time sources. On thereceive side, there are also be similar crystal oscillators or other orother accurate time sources, such that the difference in the fundamentalfrequency will be on the order of only hundreds of parts per million.Additionally, the sequence lengths of the pseudo noise generationcircuits are not overly large, inasmuch that the repeat length isrelatively short. All these factors add up to a system that can besimple to implement, and therefore low cost.

The encoding/decoding system admits aforementioned simplifications,allowing us to forego a lengthy initial acquisition procedure. Thereceiver will be running close to the chip rate of the transmitter aswell as the relative phase of the PN generator in the receiver can beeasily acquired. In fact, the circuit implemented is simply a trackingsystem that acquires the relative phase of the receiver in respect tothe transmitter with a slight variation on the ability to changefrequency to match frequency of the transmission circuit.

The synchronization acquisition system can be described as a slidingcorrelator that takes as inputs the received signal from the media aswell as output from a PN generator that is local to the receiver. Thelocal PN generator is driven from a PLL or phase lock loop which has anarrow band of frequency diversity, i.e. it natively will run at closeto the target frequency and has a band of control around that centerfrequency. The output from the sliding correlator is analyzed todetermine whether or not a lock condition has been achieved or if thefrequency is either too high or too low, this lock detector then drivesa PLL to either speed up or slow down first to stay the same in afeedback loop.

The sliding correlator can be implemented as either a sampled anddigitized representation of the incoming signal in which case thecorrelation is formed in digital logic. Another implementation of thesliding correlator can be as switched analog circuitry, in which in thiscase the incoming signal is sampled and the correlation is performed inswitched capacitor circuitry.

One classical technique in the acquisition process would be to havecourse phase alignment accomplished through searching through thevarious taps or delays, of the receiver PN generator and subtle phasefrequency alignment being accomplished to the PLL. However, in anembodiment of the system, the time required to search through all of theavailable tops in the PN sequence generator is relatively short.Classically one might search amongst the various tabs of the PNgenerator to find a correlation spike that is relatively close and thenfine-tune this correlation by changing the frequency of the PLL. Throughthis it becomes possible to accomplish both coarse and fine adjustments.Because an embodiment of the system is relatively unconstrained, itbecomes possible simply to slide the phase by changing the frequency andaccomplishing both the course and the fine adjustments through thechanging of the PLL.

A further embodiment allows the transmitter to send a training sequencethat has predetermined characteristics to facilitate synchronizationacquisition and tracking. This training sequence may occur at thebeginning of every grouping of data video data or it actually may existas a sub band, i.e. modulated by a further code orthogonal to all of thecodes in the code book applied to the payload snippets and transmittedat the same time, continuously. The independent training sequence, orsub-band, serves as a probe of the EM characteristics of the EM pathway,which may in turn be referenced for parametric tuning of signalcorrection circuits, such as pre-emphasis. Henceforth this signal isreferred to as the “probe signal” without loss of generality. This probesignal may be held constant over k transport intervals, for somepredetermined k, and its associated code made k*L chips long. As withthe payload samples in the input vector, this probe signal may beimplemented either with discrete (digital) or with continuous(pulsatile) representations. This approach enhances the resilience ofthe probe track to noise, interference, and reflections. In thisapplication, the probe signal is particularly powerful in facilitatingacquisition and tracking because the probe signal can be made to have aconstant amplitude that allows channel attenuation to be measureddirectly.

Another preferred embodiment is the parallel correlation system shown inFIG. 11. This system analyzes adjacent taps in the PN sequencegenerator. By studying three adjacent taps and the correlation relatingto each of those individual taps, the lock detection algorithm isgreatly simplified.

In a further embodiment, the receiving circuit is adapted to retransmita phase-aligned and synchronized signal back to the transmitting circuitin an independent sub-band. Completing the control loop in this mannerallows the transmitter to transition, an embodiment, between providingthe probe signal versus encoding payload snippets. Upon initialpower-up, the transmitting circuit transmits the probe signal until itacquires a sub-band signal that is returned from the receiving circuit.When the returned signal is received, the transmitting circuit thenstarts transmitting data according to the received parameters. Thisclosed-loop control system allows a robust and self-calibrating LST tobe implemented.

LST Optimization

In an LST, a transmitter sends energy over an EM pathway to a receiver.The LST payload comprises one or more sampled signal snippets. For eachset of payload snippets, the LST assembles an input vector, encodes theinput vector, transmits a signal into the imperfect EM pathway, receivesa signal from the other end of the EM pathway, decodes the receivedsignal into an output vector, and distributes the output vector toreconstructed payload snippets. The exactness of the correspondencebetween the reconstructed payload and the input payload is determinedentirely by the electrical quality of the EM pathway and by the encoderassembly and decoder assembly implementations.

The electrical quality of the EM pathway in turn depends both uponphysical variation in materials and assemblies and upon environmentalinterference. As a result, the signal received at the decoder assemblydiffers from the signal transmitted by the encoder assembly. Thedifference between the transmitted and the received signals isdetermined by, for example, roll-off, reflections due to impedancemismatches, and impinging aggressor signals.

A reconstructed payload signal 502 longer than a single distributinginterval 102 is encoded over the course of several distributingintervals and thus over the course of several decoding intervals 14 andcorrespondingly several transport intervals 2. In a preferredembodiment, the parameters defining the decoder assembly 328, includingtransport interval, decoding interval, distributing interval, N 8, L 10,code book 356, and permuter 348 permutation all remain constantthroughout the steps involved in processing of one set of reconstructedpayload samples 357 corresponding to a single set of output vector 352contents. In one embodiment of the decoder assembly, all of the decodingparameters are “hard coded” and cannot be changed. Because the decodingof one output vector is logically independent from the decodings of allprevious and of all following output vectors, there is no reason thatthe decoding parameters cannot change from one output vector's worth ofreconstructed payload samples to the next. Therefore, in anotherembodiment of the decoder assembly, any of the decoding parameters maybe varied from one distributing interval to the next under algorithmiccontrol, for example in response to changes in payload characteristics,EM pathway 314 characteristics, and/or application requirements.

In another embodiment of an analog version of the decoder assembly 328,the analog portion can be implemented as a switched capacitor circuit.Given that the operation of this circuit will entail the use of sampleand hold circuits, multiplier circuits and a pipeline type operation, itshould be obvious to those skilled in the art the similarities tostate-of-the-art ADC design. Indeed, one such implementation of theanalog decoder assembly allows for accommodating any amplituderepresentation, from binary through n-ary to continuous, through thesimple selection of thresholding levels in the pipeline operation of thedecoder assembly. In an embodiment, a decoder assembly is designparametrically reconfigurable to accommodate either digital signals orpulsatile signals, thereby enabling system flexibility.

FIG. 10 shows the architecture of an embodiment of one synchronizationacquisition and tracking circuit, which can be described as a slidingcorrelator. The key input is the received signal 214, and the key outputis the clock signal 826. The circuit in FIG. 10 comprises a PN generator814, clocked by a phase-locked loop (PLL) 810, which is adjusted finelyby the correlation peak detector 320. The PN generator is designed so asto have a narrow band of frequency diversity, i.e. it natively will runat close to the target frequency and has a band of control around thatcenter frequency. The output 824 from the sliding correlator is analyzedin the correlation peak detector to determine whether or not a lockcondition has been achieved or if the frequency is either too high ortoo low. This lock detector then adjusts the PLL frequency to servo onsynchronization.

The sliding correlator shown in FIG. 10 can be implemented as either asampled and digitized representation of the incoming signal in whichcase the correlation is formed in digital logic. Another implementationof the sliding correlator can be as switched analog circuitry, in whichin this case the incoming signal is sampled and the correlation isperformed in switched capacitor circuitry. One embodiment simply adjuststhe phase by changing the frequency and accomplishing both the coarseand the fine adjustments by adjusting the PLL frequency.

In an alternative embodiment, the encoder assembly 326 sends a trainingsequence with known characteristics as a preamble to a series of vectortransmissions, so as to facilitate synchronization acquisition andtracking. This training sequence may occur at the beginning of everyvector transmission, or it may be transmitted as an independent snippetalong with the input payload snippets. Sending the training sequence asan independent payload signal allows this probe signal to characterisethe quality of transmission media. Such characterization data is usedfor various signal correction parameters like pre-emphasis.Additionally, the training sequence signal could also be of much longerperiod than one collecting interval, increasing resilient against noiseand interference. In the present disclosure, the training sequence isparticularly powerful in facilitating acquisition and tracking simplybecause the training sequence can be made to have a constant amplitude.

An example of a parallel-correlation synchronization acquisition andtracking system is shown in FIG. 11. This system analyses adjacent taps902, 904, and 906 in the PN sequence generator 814. By evaluating threeadjacent taps concurrently, as well as the correlation relating to eachof those individual taps, in the correlation spike detector 320, thelock detection algorithm is greatly simplified.

In a further embodiment, the receiving circuit is adapted to retransmita phase-aligned and synchronized signal back to the transmitting circuitin an independent sub-band. Completing the control loop in this mannerallows the transmitter to transition, an embodiment, between providingthe probe signal versus encoding payload snippets. Upon initialpower-up, the transmitting circuit transmits the probe signal until itacquires a sub-band signal that is returned from the receiving circuit.When the returned signal is received, the transmitting circuit thenstarts transmitting data according to the received parameters. Thisclosed-loop control system allows a robust and self-calibrating LST tobe implemented.

FIG. 12 shows a straightforward round-robin permutation of the permuter348, wherein a next sample 302 from each successive index in the decoderoutput vector 352 is distributed in turn to the next sample 804 in thenext signal 502 in the set of reconstructed payload snippets α′, β′, . .. , ω′ until all N output vector locations have been exhausted. Thereare potentially different numbers of samples per reconstructed payloadsnippet, all distributed during the one distributing interval. Thenumbered circles indicate the order in which the decoder output vectorcontents are distributed to reconstructed payload snippets during thedistributing interval. Exactly N samples are distributed during thedistributing interval.

Although there are N! equally good choices for permuter 348 permutation,successful payload transport demands that the decoder 512 permutationimplement the inverse of the encoder 510 permutation 510 (shown in otherfigures). Ensuring agreement regarding such details is appropriately thesubject of international standards, rather than of the presentdisclosure.

The schema drawn in FIG. 12 applies to many possible types of signal.For example, there could be a single payload signal, consisting of arepresentation of video wherein each successive sample is a color value(for example, 3 (R/G/B) per pixel). Another example is also a singlepayload signal, this one consisting of color values from severalindependent video signals are interleaved. Further examples includediverse types of signal, for example, video, audio, chemical,mechanical/haptic, and so forth. An embodiment of one such hybridexample includes different numbers of samples from/to each payloadsignal during each transport time interval. Further examples includeeach of the four types of signal (digital, analog, pulsatile, andneural) solo or in combination.

FIG. 13 illustrates round-robin assignment of samples from indices in an8-element decoder output vector to a parallel-RGB output video signalarising from reception of a first transport interval.

FIG. 13 illustrates an especially common special case of the generalschema described in FIG. 12. In this example, the reconstructed payloadconsists of 3 signals 502, representing the R, G, and B color planes,respectively, of a single reconstructed RGB-based video signal. N, thenumber of elements in the decoder 512 output vector 352, happens to be8. This example shows the round-robin assignment during a givendistributing interval.

Further to the example begun in FIG. 13, FIG. 14 illustrates round-robinassignment during the immediately following distributing interval.

FIG. 15 shows the structure of a binary code book which is a subset ofthe identity matrix, for the case where L=N+3. The chip index j 916 runsfrom 0 to L−1 horizontally across the figure, and the input/outputvector index i 914 runs from 0 to N−1 vertically down the figure.

FIG. 16 shows an example of a 127×127 binary code book whose codes iseach a unique rotation of a common PN sequence. In the figure, a blacksquare corresponds to a “1” value, while a white square corresponds to a“−1” value. The matrix for pulsatile modulation is constructed per thefollowing steps:

-   -   1. Instantiate the L×L identity matrix    -   2. Keep only the 1^(st) N rows    -   3. Convert 0 entries to −1 values    -   4. The result is the example code book depicted in FIG. 16

FIG. 17 shows an example of a 128×128 binary code book, which is aWalsh-Hadamard matrix. In the figure, a black square corresponds to a“1” value, while a white square corresponds to a “−1” value.

FIG. 18 shows an example of a 128×128 binary code book, which isconstructed by convolving a Walsh-Hadamard matrix with a near-PNsequence. In the figure, a black square corresponds to a “1” value,while a white square corresponds to a “−1” value.

In an embodiment, the payload signals 500 and 502 comprise videosignals, for example as illustrated in FIG. 5, FIG. 6, FIG. 13, and FIG.14 for the case of fully populated R/G/B color planes. FIG. 19 shows oneembodiment wherein the subject of this disclosure is applied to (a classof) video systems. The architecture depicted in FIG. 19 comprises apredetermined number C of cameras 516 and another predetermined number Dof displays 518. The architecture depicted in FIG. 19 also includes amedia processing unit (MPU) 548. The MPU in turn contains a videoprocessor 536, non-volatile storage 560, with which the video processorexchanges storage signals 562, and a Wide Area Network interface 544,through which the video processor communicates with the Internet 576 viaInternet Protocol signals 546.

The camera 516 depicted in FIG. 19 comprises a lens 520, which refractsincident light 528 to project focused light 534 onto a focal plane 554occupied by an image sensor 522. The image sensor produces an outputsignal 524 which comprises an ordered series of light measurements, eachmeasurement corresponding to a geometric location within the focalplane, wherein each measurement is acquired during a predetermined imagesensor exposure interval 4. In one pipeline-balanced embodiment, theimage sensor exposure interval equals the transport interval 2. Thecamera also includes an encoder assembly 326. 538 is a circuit thatadapts image sensor output samples as an input payload signal for theencoder.

The image sensor 522 output signal 524 is intrinsically pulsatile;converting to digital signals uses an additional analog-to-digitalconverter circuit, which cannot possibly add fidelity while certainlyadding non-zero manufacturing cost. A simplest embodiment of the subjectof this disclosure conveys pulsatile signals directly, without requiringanalog-to-digital conversion of the light measurements, resulting infit-for-purpose transmission of high-resolution video signals at leastcost compared to prior arrangements.

The display 518 shown in FIG. 19 comprises a decoder assembly 328, acircuit 540 that adapts the decoder assembly output (reconstructeddisplay control signal snippets) to the input 526 of display elementarray controller 556. The array controller generates a series ofbrightness control values 558. Each brightness control value determinesthe brightness maintained during each predetermined display arrayrefresh interval 6 of the light-emitting element at each geometriclocation within the array 530 of display elements. In onepipeline-balanced embodiment, the display array refresh interval equalsthe transport interval 2. The display array consists of elements, suchas certain kinds of diodes, which emit light 552. Viewers' brainsinterpret such activity over time as moving images.

In a video embodiment of FIG. 19, the centrepiece of the video systemdepicted in is the central processing unit (MPU) 548, which in turn isbased on a video processor 536. The MPU receives a signal from everycamera 516 via LST 1, and the MPU transmits a signal to every display518 in the system via LST 1. All of the camera signals and all of thedisplay signals each is independent from all other video signals in thesystem. A potentially trivial circuit 568 adapts each decoder assemblyoutput 570 (reconstructed camera output signal snippets) to the dataformat required for the video processor. Similarly, a potentiallytrivial circuit 574 adapts prepared display input signals 566 from thedata format of the video processor to an input payload signal 566destined for the corresponding display. Circuits 568 and 574 are wellknown in the art.

In an embodiment, the MPU 548 performs a variety of operations on video,including decoding stored content 562 retrieved from non-volatile memory560, storing compressed video signals 562 to non-volatile memory, and/orexchanging Internet Protocol signals 546 with the Internet 576 via a WANModem 544. A bidirectional converter 542 translates between Ethernetpackets and the pulsatile or digital signals occupying the datapaths ofthe video processor.

In one embodiment, the video processor 536 is a CPU. In anotherembodiment, the video processor is a GPU. The video processor may beimplemented either with digital datapaths or with pulsatile datapaths.Digital datapaths demand A/D on inputs and D/A on outputs and aretherefore intrinsically less efficient for video than pulsatiledatapaths.

A broad diversity of common video systems are seen to be parametricvariants of the schema sketched in FIG. 19, for example:

-   -   In one embodiment of a home entertainment system circa 1990:        C=0—there are no cameras. D=1—a CRT display is encased in a box        that sits on a table. The MPU 548 is a tuner/amplifier circuit        assembly, the EM pathway 314 is coaxial cable, and the LST 1 is        PAL.    -   In one embodiment of a home entertainment system circa 2016,        C=2—a Kinect system includes stereo monochrome computer vision.        D=1—an HDMI display hangs on the wall. The MPU 548 is a gaming        machine such as, for example, a PlayStation™ of Sony or Xbox™ of        Microsoft, the EM pathway 314 is HDMI cable, and the LST 1 is        HDMI.    -   In one possible embodiment of a home entertainment system, for        example one implementing iVR™ (“immersive virtual reality”),        C=256—high-resolution cameras provide 3D 360-degree machine        vision inputs, making a whole new range of inputs available for        gesture- and movement-based interfaces. D=2048—every solid wall,        ceiling, and floor is constructed from flexible, rugged display        panels. The MPU 548 is a computationally enhanced variant of a        PlayStation or Xbox. The EM pathway 314 is any American Wire        Gauge (AWG) wire pair, and the LST 1 is the subject of the        present disclosure. This embodiment enables an experience that        is qualitatively different from what is heretofore expected of        pixel-rich Internet content.    -   In one embodiment of a passenger vehicle system, C=8—a variety        of infrared (IR) and ultraviolet (UV) and visible light sensors        collects data for machine vision analysis for safety.        D=4—displays are provided on the dash and in front seat head        rests, for rear passenger entertainment. The MPU 548 is the        engine control unit (ECU). The EM pathway 314 is CAT-3, and the        LST 1 is LVDS.    -   In one possible embodiment of a passenger vehicle system, C=32—a        variety of IR and UV and visible light sensors collects data for        machine vision analysis for safety, and video-intensive Internet        interaction is enabled for passengers. D=64—displays are        provided on all solid surfaces and on exterior glass and on the        dash, both for control and for passenger entertainment. The MPU        548 is the engine control unit (ECU). The EM pathway 314 is        inexpensive cable, and the LST 1 is the subject of the present        disclosure. This embodiment enables passengers to enjoy iVR        entertainment experiences, while the driver can take advantage        of the most responsive possible heads-up display for controlling        the vehicle.    -   In one embodiment of a retail signage video system (e.g., fast        food restaurant menus), the MPU 548 is a tower PC or server. The        EM pathway 314 is CAT-5/6, and the LST 1 is HDBaseT.    -   In one possible embodiment of a retail signage video system, the        MPU 548 is a tower PC or server. The EM pathway 314 is any AWG        wire pair, and the LST 1 is the subject of the present        disclosure. This embodiment allows displays 518 to be placed        further away from the MPU, thus saving costs by allowing a        single MPU to accommodate a larger number of displays. Moreover,        the cables are far less expensive, and it is easy to terminate        such cables in the field (currently a major barrier to HDMI        enabling iVR).    -   In one embodiment of an HD video surveillance system, the MPU        548 is a DVR. The EM pathway 314 is coaxial cable, and the LST 1        is Analog HD.    -   In one possible embodiment of an 8K video surveillance system,        the MPU 548 is a DVR. The EM pathway 314 is any AWG wire pair,        and the LST 1 is the subject of the present disclosure. This        embodiment carries high-resolution video cost-effectively over        legacy infrastructure cabling.    -   Other embodiments that can be shown to be parametric        instantiations of the schema of FIG. 19 include a circa 1970        cinema system wherein C=0 and D=1, an example surround-view        system wherein C=0 and D=8, a futuristic iVR cinema system        wherein C=64 and D=64, an HD rock concert video system wherein        C=8 and D=8, and an 8K rock concert video system, wherein C=128        and D=128, that enables high-resolution live experiences        incorporating video feeds of performers, audience members,        prepared video signals, and synthetically generated video        signals.

The subject of the present disclosure is aspects of an LST 1 thattransfers any type of sampled signal 500 along an EM pathway 314. Inmany applications requiring transport of video, audio, and other kindsof data signals, it is desirable also to be able to transportinformation along the EM pathway in the direction opposite to that ofthe main payload information flow. For example, the MPU 548 shown inFIG. 19 may benefit from the ability to send control and configurationinformation to sensors, including cameras and microphones. The disclosedLST does not preclude low-bandwidth upstream communication.

The encoder assembly 326 encodes a vector of N samples every encodinginterval. If we call the number of encoding intervals per second f (sof=1/encoding interval), the throughput of the encoder assembly is Nfsamples per second, making available Lf samples per second fortransmission into the EM pathway 314, where L>=N. For example, 1920×10801080p60 HD Video, is approximately 2 million pixels or 6 million samplesper frame, or 360 million samples per second for an RGB encoding of eachpixel. That tells us Nf=360e6=0.36e9. It might reasonably be expectedthat Lf=1 GHz=1e9. Then N/L=0.36, or for L=128, N=46. The encoderassembly transmits the entire ordered series of output values during thetransport interval 1.

FIG. 20 shows an example oscilloscope trace of a signal arriving fromthe EM pathway 314 at the decoder assembly 328 input terminal 340. Thevertical scale is voltage, and the horizontal scale is 100 psoscilloscope measurement interval. In FIG. 20, 20 oscilloscopemeasurement intervals correspond to one chip interval τ.

Throughout the specification and the claims that follow, unless thecontext requires otherwise, the words “comprise” and “include” andvariations such as “comprising” and “including” will be understood toimply the inclusion of a stated integer or group of integers, but notthe exclusion of any other integer or group of integers.

The reference to any prior art in this specification is not, and shouldnot be taken as, an acknowledgement of any form of suggestion that suchprior art forms part of the common general knowledge.

It will be appreciated by those skilled in the art that the invention isnot restricted in its use to the particular application described. Inparticular, while some of the examples shown are for RGB full-colorimages, the subject of this disclosure applies regardless of thedepth/number of payload signals or color space of any video in thepayload, including all variants of chroma/luma separated (andchroma-sub-sampled) color spaces (e.g., YUV, YUV 4:2:0, etc.), as wellas Monochrome (i.e., just Y). Neither is the present inventionrestricted in its preferred embodiment with regard to the particularelements and/or features described or depicted herein. It will beappreciated that the invention is not limited to the embodiment orembodiments disclosed, but is capable of numerous rearrangements,modifications and substitutions without departing from the scope of theinvention as set forth and defined by the following claims.

The invention claimed is:
 1. A method for transmitting a payloadconsisting of one or more sampled signals and receiving at least onesecondary signal, both the transmitting and receiving being over anelectromagnetic propagation pathway, the method configured to repeatedlyperform the steps: permuting a primary input vector of samples from theone or more payload sampled signals using a first predeterminedcollecting permutation to form a permuted primary input vector; encodingthe permuted primary input vector with reference to a predeterminedprimary code set into an ordered series of primary output values whereineach of the codes in the predetermined primary code set is unique andeach sample of the permuted primary input vector is encoded with respectto a corresponding code in the predetermined primary code set;transmitting the ordered series of primary output values into theelectromagnetic propagation pathway; and receiving at least one encodedsecondary signal; decoding the at least one received encoded secondarysignal by decoding with reference to a predetermined secondary code setinto an ordered series of secondary output values wherein each of thecodes in the predetermined secondary code set is unique and orthogonalcompared to the predetermined primary code set and to make available atleast one decoded secondary signal.
 2. The method of claim 1 wherein atleast one of the received encoded secondary signals is a digital signalfor controlling which predetermined collecting permutation to use in asubsequent permuting step.
 3. The method of claim 1 wherein at least oneof the received encoded secondary signals is a digital signal forcontrolling which predetermined primary code to use in a subsequentencoding step.
 4. The method of claim 1 wherein at least one of thereceived encoded secondary signals is a digital signal representative ofan audio signal.
 5. The method of claim 1 wherein at least one of thereceived encoded secondary signals is a digital signal representative ofa command signal for commanding the change of the predetermined primarycode set used in the encoding step.
 6. The method of claim 1 wherein atleast one of the received encoded secondary signals is a digital signalrepresentative of a command and control signal.
 7. The method of claim 1wherein at least one of the received encoded secondary signals is adigital signal representative of a command signal for commanding thechange of the predetermined secondary code set used in the decodingstep.
 8. The method of claim 1 wherein at least one of the receivedencoded secondary signals is a pulsatile signal.
 9. The method of claim1 wherein the payload is a video signal.
 10. The method of claim 1wherein the payload is a video signal provided by a video camera havingpan, tilt and zoom functions and the at least one decoded secondarysignal is a command and control signal to vary the pan, tilt and zoomfunctions of the video camera.
 11. A method for receiving a signalrepresentative of a payload consisting of one or more sampled signalswhich has been permuted according to a predetermined collectingpermutation and encoded according to a predetermined primary code set,and transmitting at least one input secondary signal, both the receivingand transmitting being over an electromagnetic propagation pathway, themethod configured to repeatedly perform the steps; receiving a signalrepresentative of the input payload as an ordered series of primaryinput values from the electromagnetic propagation pathway; decoding theordered series of primary input values with reference to thepredetermined primary code set into a primary output vector of samples,wherein the predetermined primary code set is the same as thepredetermined primary code set which encoded the ordered series ofprimary input values; permuting the primary output vector of samplesinto a reconstructed output payload representative of the payload usinga respective predetermined distributing permutation which is an inverseof a respective predetermined collecting permutation; receiving at leastone secondary signal; encoding with reference to a predeterminedsecondary code set at least one received secondary signal into asecondary output vector wherein each of the codes in the predeterminedsecondary code set is unique and orthogonal compared to thepredetermined primary code set, and transmitting the secondary outputvector of at least one encoded secondary signal over the electromagneticpropagation pathway.
 12. The method of claim 11 wherein at least one ofthe secondary signals is a digital signal for controlling whichpredetermined collecting permutation to use in a subsequent permutingstep.
 13. The method of claim 11 wherein at least one of the secondarysignals is a digital signal for controlling which predeterminedsecondary code to use in a subsequent encoding step.
 14. The method ofclaim 11 wherein at least one of the secondary signals is a digitalsignal representative of an audio signal.
 15. The method of claim 11wherein at least one of the secondary signals is a digital signalrepresentative of a command signal for commanding a change of thepredetermined primary code set used to encode the payload.
 16. Themethod of claim 11 wherein at least one of the received secondarysignals is a digital signal representative of a command and controlsignal.
 17. The method of claim 11 wherein at least one of the receivedsecondary signals is a digital signal representative of a command signalfor commanding a change of the predetermined secondary code set used ina subsequent decoding.
 18. The method of claim 11 wherein the payload isa video signal.
 19. The method of claim 11 wherein the payload is avideo signal provided by a video camera having pan, tilt and zoomfunctions and the at least one secondary signal is a command and controlsignal to vary the pan, tilt and zoom functions of the video camera. 20.The method of claim 11 wherein when the payload is digital samples andthe reconstructed output payload are digital samples.
 21. The method ofclaim 11 wherein when the payload is pulsatile samples and thereconstructed output payload are pulsatile samples.
 22. The method ofclaim 11 wherein when the payload is pulsatile samples and thereconstructed output payload are digital samples.
 23. The method ofclaim 11 wherein when the payload is digital samples and thereconstructed output payload are pulsatile samples.
 24. The method ofclaim 11 wherein the payload includes both digital samples and pulsatilesamples and the reconstructed output payload includes both digitalsamples and pulsatile samples.
 25. An apparatus for repeatedlycommunicating a payload consisting of one or more sampled signals andreceiving at least one secondary signal, both the transmitting andreceiving being over an electromagnetic propagation pathway, theapparatus comprising: a permuter to permute a primary input vector ofsamples from one or more payload signals using a first predeterminedcollecting permutation to form a permuted primary input vector; anencoder to encode the permuted primary input vector with reference to apredetermined primary code set into an ordered series of primary outputvalues wherein each of the codes in the predetermined primary code setis unique and each sample of the permuted primary input vector isencoded with respect to a corresponding code in the predeterminedprimary code set; a transmitter for transmitting the ordered series ofprimary output values into the electromagnetic propagation pathway; anda receiver for receiving at least one encoded secondary signal; and adecoder for decoding the at least one received encoded secondary signalby decoding with reference to a predetermined secondary code set into anordered series of secondary output values wherein each of the codes inthe predetermined secondary code set is unique and orthogonal comparedto the predetermined primary code set and to make available at least onedecoded secondary signal.
 26. The apparatus of claim 25 wherein at leastone of the received encoded secondary signals is a digital signal forcontrolling which predetermined collecting permutation to use in asubsequent permuting step used by the permuter.
 27. The apparatus ofclaim 25 wherein at least one of the received encoded secondary signalsis a signal for controlling the encoder.
 28. The apparatus of claim 25wherein at least one of the received encoded secondary signals is adigital signal representative of an audio signal.
 29. The apparatus ofclaim 25 wherein at least one of the received encoded secondary signalsis a digital signal representative of a command signal for commandingthe change of the predetermined primary code set used in the encodingstep.
 30. The apparatus of claim 25 wherein at least one of the receivedencoded secondary signals is a digital signal representative of acommand and control signal.
 31. The apparatus of claim 25 wherein atleast one of the received encoded secondary signals is a digital signalrepresentative of a command signal for commanding the change of thepredetermined secondary code set used in the decoding step used by thedecoder.
 32. The apparatus of claim 25 wherein at least one of thereceived encoded secondary signals is a pulsatile signal.
 33. Theapparatus of claim 25 wherein the payload is a video signal.
 34. Theapparatus of claim 25 wherein the payload is a video signal is madeavailable by a video camera having pan, tilt and zoom functions and theat least one decoded secondary signal is a command and control signal tovary the pan, tilt and zoom functions of the video camera.
 35. Anapparatus for repeatedly receiving a signal representative of a payloadconsisting of one or more sampled signals which has been permutedaccording to a predetermined collecting permutation and encodedaccording to a predetermined primary code set, and transmitting at leastone input secondary signal, both the receiving and transmitting beingover an electromagnetic propagation pathway, the apparatus comprising: areceiver for receiving a signal representative of the input payload asan ordered series of primary input values from the electromagneticpropagation pathway; a decoder for decoding the ordered series ofprimary input values with reference to the predetermined primary codeset into a primary output vector of samples, wherein the predeterminedprimary code set is the same as the predetermined primary code set whichencoded the ordered series of primary input values; a permuter forpermuting the primary output vector of samples into a reconstructedoutput payload representative of the payload using a respectivepredetermined distributing permutation which is an inverse of arespective predetermined collecting permutation; a receiver forreceiving at least one secondary signal an encoder for encoding withreference to a predetermined secondary code set at least one receivedsecondary signal into a secondary output vector wherein each of thecodes in the predetermined secondary code set is unique and orthogonalcompared to the predetermined primary code set; and a transmitter fortransmitting the secondary output vector of at least one encodedsecondary signal over the electromagnetic propagation pathway.
 36. Theapparatus of claim 35 wherein at least one of the secondary signals is adigital signal for controlling which predetermined collectingpermutation to use in a subsequent permuting step of the permuter. 37.The apparatus of claim 35 wherein at least one of the secondary signalsis a digital signal for controlling which predetermined secondary codeto use in a subsequent encoding step of the encoder.
 38. The apparatusof claim 35 wherein at least one of the secondary signals is a digitalsignal representative of an audio signal.
 39. The apparatus of claim 35wherein at least one of the secondary signals is a digital signalrepresentative of a command signal for commanding the change of apredetermined primary code set used to encode the payload.
 40. Theapparatus of claim 35 wherein at least one of the received secondarysignals is a digital signal representative of a command and controlsignal.
 41. The apparatus of claim 35 wherein at least one of thereceived secondary signals is a digital signal representative of acommand signal for commanding a change of the predetermined secondarycode set used in a subsequent decoding.
 42. The apparatus of claim 35wherein the payload is a video signal.
 43. The apparatus of claim 35wherein the payload is a video signal provided by a video camera havingpan, tilt and zoom functions and the at least one secondary signal is acommand and control signal to vary the pan, tilt and zoom functions ofthe video camera.
 44. The apparatus of claim 35 wherein when the payloadis digital samples and the reconstructed output payload signals aredigital samples.
 45. The apparatus of claim 35 wherein when the payloadis pulsatile samples and the reconstructed output payload signals arepulsatile samples.
 46. The apparatus of claim 35 wherein when the inputpayload is pulsatile samples and the reconstructed output payloadsignals are digital samples.
 47. The apparatus of claim 35 wherein whenthe payload is digital samples and the reconstructed output payloadsignals are pulsatile samples.
 48. The apparatus of claim 35 wherein thepayload includes both digital samples and pulsatile samples and thereconstructed output payload includes both digital samples and pulsatilesamples.